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DLA-LQ 


FOREWORD 


The  Defense  Logistics  Agency  (DLA)  Competition  Advocate  Office 
requested  that  DLA's  Operations  Research  and  Economic  Analysis  Office 
(DLA-LO)  determine  the  impact  of  competition  and  how  it  affects  the 
quality  of  items  bought  by  the  Defense  Supply  Centers  (DSCs).  This 
report  details  the  analysis  of  how  competition  impacts  quality  of 
DLA-managed  items.  Specifically  addressed  were  how  the  quality 
patterns  of  items  broken  out  from  sole  source  to  multiple  sources  and 
those  items  which  reverted  from  multiple  sources  to  sole  source  have 
changed . 

The  analysis  indicated  that  for  the  vast  majority  of  items  broken  out 
to  competition  that  there  were  no  recorded  valid  contractor-caused 
complaints  from  the  Customer  Depot  Complaint  System  (CDCS)  file  and  no 
recorded  Quality  Evaluation  Program  (QEP)  actions.  When  complaints 
from  CDCS  were  present,  the  results  were  mixed.  When  QEP  activity 
occurred,  it  was  more  frequent  after  breakout  than  before.  This 
increased  QEP  level  was  typically  due  to  increased  oversight 
(pre-award  surveys,  first  article  tests,  and  Quality  Assurance  Letters 
of  Instruction)  and  not  necessarily  because  of  quality  problems. 
Therefore,  it  appears  that  there  were  no  measurable  differences  in  the 
quality  of  items  broken  out  to  competition.  However,  to  prevent  a 
possible  decline  in  quality,  a  DSC  will  occasionally  increase  its 
level  of  quality  oversight  functions. 

There  are  no  recommendations  from  an  agency  management  perspective. 
However,  from  an  analytical  perspective,  this  issue  should  perhaps  be 
analyzed  again  in  the  future  when  more  extensive  data  has  been 
accumulated  and/or  the  procurement  environment  has  changed. 


CHRISTINE  GALLO 

Deputy  Assistant  Director 
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EXECUTIVE  SUMMARY 


l 

\ 

l4 

In  Fiscal  Year  1986,  the  Defense  Logistics  Agency  (DLA)  Competition 
Advocate  requested  that  an  analysis  be  conducted  on  the  impact  of 
competition  on  the  quality  of  items  bought  by  the  Defense  Supply  Centers 
(DSCs) .  This  was  requested  since  it  was  unclear  what  impact  the  many 
recent  competition  and  contracting  initiatives  had  on  the  quality  of  DLA- 
managed  items.  The  Operations  Research  and  Economic  Analysis  Office  (DLA- 
LO)  agreed  to  undertake  the  project,  but  this  effort  was  initially 
backlogged  due  to  lack  of  data.  With  recent  DLA-LO  experience  with  the 
Customer  Depot  Complaint  System  (CDCS)  and  Quality  Evaluation  Program  (QEP) 
data  bases,  DLA-LO  believed  that  sufficient  data  existed  to  activate  this 
project  during  1989. 

The  thrust  of  this  analysis  was  to  measure  competition  and  quality 
indicators  both  prior  to  and  after  changes  in  the  competition  status  codes. 
This  was  accomplished  by  having  competition  measured  by  changes  in  the 
Acquisition  Method  Code/Acquisition  Method  Suffix  Code  that  indicated  an 
item  was  broken  out  from  sole  source  to  competition  or  that  an  item 
reverted  from  competition  to  sole  source.  Only  items  with  subsequent 
awards  after  the  change  in  competition  status  and  purchased  from 
manufacturers  were  considered.  Quality  indicators  were  derived  from  two 
sources .The  CDCS  file  tracked  quality  problems  or  complaints  (Product 
Quality  Defibi^jncy  Reports  and  Reports  of  Discrepancy)  and  the  QEP  file 
tracked  actions \designed  to  assure  quality  (First  Article  Data,  Preaward 
Surveys  Data,  Po'st  Award  Data,  Nonconformance  Data,  Special  Quality 
Assurance  Data,  Quality  Assurance  Letter  of  Instruction  and  Quality  Data). 
Finally,  the  analysis  sought  to  determine  the  actual  impact  of  competition 
on  quality  by  comparing  the  quality  patterns  both  prior  to  and  after  the 
competition  status  changes.  ,  - 

l  J1  •s 

The  results  of  the  study  showed  that  for  the  vast  majority  of  contract 
lines  (i.e.,  average  of  96  percent)  there  were  no  valid  contractor-caused 
complaints  on  file  before  or  after  a  change  in  competition  status.  When 
complaints  were  present  the  results  were  mixed.  For  example,  at  two 
centers  the  number  of  complaints  increased  after  breakout  to  competition 
and  the  other  two  centers  experienced  the  opposite  effect.  The  vast 
majority  of  the  time  (i.e.,  average  of  96  percent)  there  were  no  QEP 
actions  required  before  or  after  a  change  in  competition  status.  When  QEP 
activity  occurred,  it  was  more  frequent  after  breakout  than  before. 
Therefore,  it  appears  that  there  was  no  measurable  differences  in  the 
quality  of  items  after  break  out  to  competition.  However,  to  prevent  a 
possible  decline  in  quality,  a  DSC  will  occasionally  increase  its  level  of 
quality  oversight  functions. 

The  analysis  of  the  data  used  showed  that  the  data  had  some 
limitations.  The  data  used  for  this  study  was  from  relatively  new  data 
bases.  The  restricted  time  period  analyzed  and  the  infrequency  of 
occurrences  of  complaints  and  QEP  actions  may  have  influenced  the  results. 

There  are  no  recommendations  from  an  agency  management  perspective. 
From  an  analytical  perspective,  this  issue  should  perhaps  be  analyzed  again 
in  the  future  when  more  extensive  data  has  been  accumulated  and/or  the 
procurement  environment  has  changed. 


I. 


INTRODUCTION 


A.  Background .  The  impact  of  competition  and  how  it  affects  the 
quality  of  items  bought  by  the  Defense  Supply  Centers  (DSCs)  was  unknown. 
Therefore,  in  Fiscal  Year  (FY)  1986  the  Defense  Logistics  Agency  (DLA) 
Competition  Advocate' requested  that  a  study  be  conducted  to  investigate  the 
impact  of  competition  on  quality.  The  Operations  Research  and  Economic 
Analysis  Office  (DLA-LO)  agreed  to  undertake  the  project,  however  this 
effort  had  been  backlogged  due  to  lack  of  data.  With  recent  DLA-LO 
experience  with  the  Customer  Depot  Complaint  System  (CDCS)  and  Quality 
Evaluation  Program  (QEP)  data  bases,  DLA-LO  believed  that  sufficient  data 
existed  to  initiate  this  project  during  FY  89. 

B.  Problem  Statement.  It  was  unclear  what  impact  the  many  recent 
competition  and  contracting  initiatives  have  had  on  the  quality  of  DLA- 
managed  items.  This  study  addressed  the  issue  of  how  competition  impacted 
quality  of  DLA-managed  items. 

C.  Objectives .  The  objectives  of  this  study  were  to  measure 
competition  of  DSC  items,  to  measure  quality  of  DSC  items,  and  to  compare 
quality  before  and  after  a  change  in  competition  status.  For  this  study, 
breakout  was  defined  as  an  item  which  changed  from  a  sole  source 
manufacturer  to  multiple  manufacturers.  Reversion  was  defined  as  an  item 
which  changed  from  a  competition  environment  to  a  sole  source  manufacturer. 
The  first  objective  was  to  identify  the  National  Stock  Numbers  (NSNs) 
broken  out  to  competition,  which  was  the  measure  of  competition.  The 
second  objective  was  to  determine  the  measures  of  quality  for  these  items. 
Finally,  the  third  objective  was  to  determine  the  actual  impact  of 
competition  on  quality  through  the  investigation  of  quality  patterns  before 
and  after  a  change  in  competition  status. 

D.  Scope.  n  uata  base  was  created  from  records  from  the  following 
data  files:  the  Active  Contract  File  (ACF) ;  the  CDCS  files;  the  Contracting 
Technical  Data  File  (CTDF) ;  and  the  QEP  files.  Only  items  broken  out  from 
a  sole  source  manufacturer  to  other  manufacturers  determined  by  subsequent 
contract  awards  were  evaluated.  The  following  centers  were  analyzed:  the 
Defense  Construction  Supply  Center  (DCSC);  the  Defense  Electronics  Supply 
Center  (DESC) ;  the  Defense  General  Supply  Center  (DGSC) ;  and  the  Defense 
Industrial  Supply  Center  (DISC) .  The  study  excluded  the  Defense  Fuel 
Supply  Center,  the  Defense  Personnel  Support  Center  (DPSC)  -  Clothing  and 
Textile,  DPSC  -  Medical,  and  the  DPSC  -  Subsistence  due  to  their  special 
nature.  The  time  frame  of  the  data  used  varied  depending  on  the  particular 
data  base  and  center.  Table  1,  shows  the  time  frame  for  each  data  base  by 
center . 

II.  CONCLUSIONS 

A.  CDCS  Results .  For  the  vast  majority  of  contract  lines  (i.e.,  96 
percent)  there  were  no  valid  contractor-caused  complaints  on  file  before  or 
after  breakout  or  reversion.  When  complaints  were  present  the  results  were 
mixed.  For  both  DCSC  and  DISC,  the  apparent  impact  of  competition  on 
quality  has  been  to  decrease  the  number  of  customer  depot  complaints, 
whereas  for  both  DESC  and  DGSC  the  opposite  effect  has  been  observed. 
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Table  1 


DATA  SOURCES  AND  TIME  FRAMES 


Data  File 
ACF 
CDCS 

CTDF 

QEP 


Center(s) 

ALL 

DCSC.DGSC 

DESC 

DISC 

DCSC 

DESC 

DGSC , DISC 
ALL 


2nd  quarter 


Time  Frame 
1982  through  1989 

1982  through  1989 

1984  through  1989 

1983  through  1989 

1987  through  1989* 
1985*  through  1989* 
1982  through  1989* 

1985  through  1989 


B.  QEP  Results ,  Most  of  the  time  (i.e.,  96  percent),  there  were  no 
QEP  actions  required  before  or  after  breakout  or  reversion.  Uhen  QEP 
activity  occurred,  it  was  more  frequent  after  breakout  than  before. 
Therefore,  the  act  of  breaking  out  an  NSN  can  require  additional  efforts  to 
assure  quality  products  as  measured  by  the  QEP  data. 


C.  Overall ,  The  overall  results  potentially  indicated  that  the 
various  centers  may  have  emphasized  and/or  implemented  the  competition 
programs  under  different  strategies.  Additionally,  there  appeared  to  be 
other  factors  and/or  events  (e.g.,  technology  level  of  commodities)  which 
influenced  the  study  results  more  than  changes  in  competition. 
Consequently,  no  overall  conclusion  could  be  reached  with  respect  to  the 
development  of  quality  trends  due  to  competition  effects  which  would  be 
applicable  across  all  centers. 


III.  RECOMMENDATIONS 


o  From  an  agency  management  perspective,  no  recommendations  are 

made . 

o  From  an  analytical  perspective,  this  issue  should  perhaps  be 
analyzed  again  in  the  future  when  more  extensive  data  has  been  accumulated 
and/or  the  procurement  environment  has  changed. 
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IV.  BENEFITS .  The  benefits  of  this  study  were  non-quantif iable .  The 
study  showed  that  the  impact  of  the  various  competition  initiatives  on 
quality  varied  from  center  to  center.  The  centers  which  had  adverse 
effects  could  learn  from  those  centers  that  had  beneficial  effects,  and 
improvement  in  quality  may  be  possible  with  continued  emphasis  on 
competition.  However,  the  cost  of  achieving  this  improvement  may  negate 
some  of  the  savings  associated  with  lower  prices  attributed  to  competition. 

V.  IMPLEMENTATION .  This  study  represented  a  research  and  fact  finding 
effort.  The  results  of  this  study  were  for  management  information  purposes 
and  consequently  do  not  require  implementation.  The  only  follow-on  effort 
should  be  to  investigate  why  the  results  are  not  consistent  from  center  to 
center . 

VI.  METHODOLOGY .  The  methodology  for  this  study  started  with  a 
literature  review.  The  purpose  of  the  literature  review  was  to  determine 
the  extent  of  existing  literature  devoted  to  competition  and  quality 
issues,  to  determine  how  other  agencies  and  private  businesses  define 
competition  and  quality,  and  to  determine  how  to  develop  a  model  that  would 
test  the  impact  of  competition  on  quality.  The  development  of  measurements 
of  competition  were  next  in  order  to  define  and  determine  what  was 
competition.  Then  the  development  of  measurements  of  quality  were  required 
in  order  to  quantify  quality.  Finally,  an  analysis  of  the  data  was 
conducted  to  assess  the  impact  that  competition  had  on  quality.  These 
aspects  of  the  study  are  discussed  below. 

A.  Literature  Review 

An  extensive  literature  review  was  conducted  using  the  Defense  Logistics 
Studies  Information  Exchange  data  base  for  studies  and  models  relating  to 
the  evaluation  of  competition  on  quality.  A  review  of  literature  was  also 
conducted  using  the  resources  of  a  local  university  library  to  determine 
how  private  industry  measures  both  competition  and  quality.  These  reviews 
indicated  that  both  government  and  private  industry  have  differences  in  how 
they  define  competition  and  quality.  Studies  relating  to  quality  issues 
were  found.  Also,  other  studies  relating  to  competition  issues  were  found. 
The  literature  review  failed  to  find  any  studies  that  directly  related 
competition  and  quality. 

The  current  private  industry  practice  was  found  to  be  shifting  to  a  single 
source  of  supply  [1],  A  single  source  was  defined  as  using  only  one  source 
of  supply  for  a  product  when  more  then  one  source  existed  whereas  a  sole 
source  was  defined  as  the  only  manufacturer  of  an  item  or  the  item  was  not 
available  from  any  other  source.  For  example,  copier  paper  could  be 
purchased  from  numerous  manufacturers  and  vendors.  Alternatively,  a 
company  could  select  the  ABC  company  to  purchase  all  their  copier  paper 
supply.  Consequently,  ABC  would  then  be  a  single  source  for  the  copier 
paper,  but  not  a  sole  source. 

Although,  the  Federal  Government  is  prohibited  by  the  Federal  Acquisition 
Regulations  from  operating  in  this  manner  [2],  there  exist  numerous  reasons 
within  industry  for  employing  a  single  source.  The  most  common  of  these 
would  be  the  following  [3,4}. 
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1.  A  single  source  will  provide  better  service  (service  is  one 
way  that  private  industry  employs  to  measure  quality,  i.e.,  on  time 
delivery,  customer  satisfaction,  etc.). 

2.  A  single  source  will  provide  the  lowest  cost. 

3.  A  single  source  will  work  with  the  purchasing  company  and 
that  company  will  in  turn  help  to  develop  the  single  source  to  prevent 
quality  deficiencies. 

4.  Loyalty  development  between  the  company  and  the  single 

source . 

Another  industry  problem  is  that  there  exists  no  consensus  of  the 
definition  of  and  measurement  of  quality.  Each  individual  company  appears 
to  have  defined  and  measured  quality  attributes  differently.  The 
measurement  of  quality  together  with  the  "definition"  of  quality  used  in 
this  study  are  discussed  below  in  paragraph  VIC.,  Measurement  of  Quality. 

B.  Measurement  of  Competition.  The  second  step  of  the  analysis  was 
to  define  competition.  Depending  on  the  parameters  used,  it  was  found  that 
competition  could  take  on  various  forms.  The  approach  employed  by  this 
analysis  together  with  the  development  of  the  data  for  defining  competition 
are  discussed  below. 

1 .  Approach 

The  first  step  of  the  analysis  was  to  identify  the  NSNs  which  had  a  change 
in  competition  status.  For  the  purpose  of  this  study,  both  competition 
breakouts  and  NSNs  that  reverted  to  sole  source  were  analyzed.  A  breakout 
was  defined  for  this  study  to  be  an  NSN  which  was  formerly  procured  from  a 
sole  source  manufacturer  that  was  subsequently  solicited  in  a  competitive 
environment.  Whereas  a  reversion  was  defined  to  be  a  NSN  which  was 
formerly  solicited  in  a  competitive  environment  that  was  subsequently 
procured  from  a  sole  source  manufacturer.  (Note:  The  Acquisition  Method 
Codes  indicated  either  competition  or  sole  source.)  Within  both  breakout 
NSNs  and  reversion  NSNs,  the  population  was  further  classified  into  two 
groups.  In  the  first  case,  under  competitive  environments,  contracts  were 
awarded  to  multiple  manufacturers.  In  the  second  case,  under  competitive 
environments,  all  contracts  after  break  out  were  awarded  to  the  original 
sole  source  manufacturer  although  the  NSN  was  coded  as  being  eligible  for 
competition.  The  Acquisition  Method  Code/Acquisition  Method  Suffix  Code 
(AMC/AMSC)  was  used  to  identify  potential  NSNs  with  changes  in  competition 
status  -  changes  in  the  AMC  codes  from  sole  source  to  competition  and  from 
competition  to  sole  source.  These  codes  were  used  since  they  were  judged 
to  be  reliable,  reflected  the  decision  of  the  Primary  Inventory  Control 
Activity  from  a  planned  procurement  review,  assigned  by  the  DSCs  and  used 
by  competition  advocates  to  identify  NSNs  when  computing  competition 
savings . 
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The  potential  NSNs  were  then  matched  with  Commercial  and  Government  Entity 
(CAGE)  codes.  CAGE  codes  are  assigned  to  manufacturers,  dealers,  vendors, 
etc.  who  supply  items  to  the  government.  The  CAGE  codes  were  obtained  from 
the  approved  source  listing  contained  in  the  CTDF  file,  the  part  number 
segment  of  the  CTDF  file,  and  actual  purchases  from  the  ACF  file.  These 
CAGE  codes  were  then  matched  with  two  different  files  in  order  to  determine 
if  the  source  was  a  manufacturer.  Those  NSN/CAGE  pairings  which  were 
identified  as  a  nonmanufacturer,  maintenance  activity,  or  distributor  were 
eliminated.  When  it  was  found  that  an  NSN  had  multiple  CAGEs  with  the  same 
manufacturer's  part  number,  it  was  assumed  that  all  CAGEs  were  distributors 
and  consequently  that  NSN  was  subsequently  eliminated  from  the  analysis. 
For  this  study,  any  questionable  NSN/CAGE  pairing  was  eliminated  from  the 
analysis . 

The  remaining  NSNs  were  then  divided  into  the  following  categories  based  on 
the  changes  in  the  AMC/AMSC  codes. 

a.  Breakouts. 

(1)  Breakouts  from  a  sole  source  manufacturer  to 
multiple  manufacturers. 

(2)  Breakouts  from  a  sole  source  manufacturer  to  a 
single  source  manufacturer.  This  represents  the  case  where  the  original 
manufacturer  was  identified  as  the  sole  source  and  was  the  only  source  for 
the  item  after  the  item  was  broken  out  to  competition.  This  assumed  that 
the  NSN  was  competitively  solicited  but  that  the  original  sole  source 
manufacturer  had  a  competitive  advantage  and  thus  always  won  the  award. 

b.  Reversions. 

(1)  Reversions  from  multiple  manufacturers  to  a  sole 
source  manufacturer. 

(2)  Reversions  from  a  single  source  manufacturer  under 
competition  to  sole  source  manufacturer.  For  example,  if  an  NSN  was 
competitively  solicited,  but  only  one  bidder  consistently  offered,  then 
reversion  to  negotiation  under  sole  source  procedures  was  considered  and 
the  AMC/AMSC  codes  were  updated  to  reflect  sole  source. 

2 .  Development  of  Data 

The  competition  status  change  dates  were  obtained  from  the  CTDF  file.  The 
Specification/Drawing/Publication  (S/D/P)  segment  indicated  the  before  and 
after  AMC/AMSC  codes  along  with  the  date  of  change.  When  the  S/D/P  segment 
did  not  contain  the  necessary  coding  to  identify  changes  in  the  AMC/AMSC 
codes  then  the  header  portion  of  the  CTDF  file  was  used  to  identify 
AMC/AMSC  codes  changes  and  to  obtain  the  date  of  change.  This  entailed 
using  yearly  files  and  comparing  the  AMC/AMSC  changes  from  year  to  year. 
It  should  be  noted  that  only  DCSC  required  this  latter  method. 
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The  AMC  codes  were  used  to  identify  changes  in  competition  status.  AMC 
codes  "1"  and  "2"  indicated  competition  whereas  codes  "3,"  "4"  and  "5" 

indicated  sole  source.  The  AMSC  codes  were  used  to  determine  if  adequate 
technical  data  packages  were  available  for  competition.  The  AMSC  codes 
which  indicated  insufficient  technical  data  package  were  "A,"  "D,"  "H," 
"J,"  "P,"  "R"  and  "U."  When  the  AMC  code  indicated  competition  and  the 
AMSC  code  indicated  insufficient  technical  data  package,  then  the  NSN  was 
not  considered.  Appendix  A  lists  the  various  AMC/AMSC  codes  and 
definitions . 

Two  different  files  were  used  to  determine  the  type  of  CAGE.  The  CAGE  file 
from  the  Defense  Logistics  Services  Center  indicated  the  Type  of  Enterprise 
i.e.,  manufacturer,  nonmanufacturer  and  North  Atlantic  Treaty  Organization 
manufacturer  and  the  Facility  Profile  from  the  Defense  Contract 
Administration  Services  (DCAS)  Quality  Assurance  Management  Information 
System  indicated  the  Operation  Type,  i.e.,  design  and  manufacturer, 
manufacturer,  maintenance,  and  distributor.  Table  2  shows  the  codes  for 
both  the  CAGE  file  and  the  Facility  Profile  file.  Again,  it  should  be 
noted  that  the  NSN/CAGE  pairing  was  dropped  from  the  analysis  if  either  the 
Type  of  Enterprise  code  or  the  Operation  Type  code  indicated  that  the  CAGE 
was  not  a  manufacturer,  i.e.  if  the  Type  of  Enterprise  code  was  "F"  or  if 
the  Operation  Type  code  was  "C"  or  "D." 

Table  2 

CAGE  IDENTIFICATION 

Type  of  Enterprise 

(Source:  Defense  Logistics  Services  Center) 


CODE  DEFINITION 

A  Manufacturer 

E  NATO  Manufacturer 

F  Non  manufacturer 


Operation  Type 

(Source:  Defense  Contract  Administrative  Services) 


££££  DEFINITION 


A  Design  and  Manufacturer 

B  Manufacturer 

C  Maintenance 

D  Distributor 
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C.  Measurement  of  Quality.  The  third  step  of  the  analysis  was  to 
determine  how  quality  would  be  defined  and  measured.  The  actual  measure  of 
quality  was  the  lack  of  quality,  i.e.,  comparison  of  contractor-caused 
complaints  before  and  after  the  date  of  break  out.  The  measurement  of  lack 
of  quality  was  used  because  the  available  data  only  tracks  complaints  and 
problems.  The  approach  used  to  define  quality  and  to  develop  the  quality 
data  are  discussed  below. 

1 .  Approach 

There  were  several  indicators  of  quality  employed  in  this  study.  First, 
Product  Quality  Deficiency  Reports  (PQDRs)  and  Reports  of  Discrepancy 
(RODs)  caused  by  the  contractor  were  used  to  indicate  the  quality  of  NSNs. 
PQDRs  and  RODs  measure  reported  problems  with  an  NSN  and  did  not  indicate 
whether  an  NSN  produced  by  a  particular  CAGE  was  superior  in  quality.  The 
PQDR/ROD  occurrences  prior  to  the  competition  status  change  date  were 
compared  with  the  PQDR/ROD  occurrences  subsequent  to  the  competition  status 
change  date  in  order  to  determine  if  the  quality  improved  for  a  given  NSN. 
It  was  assumed  that  if  the  number  of  occurrences  declined  then  the  quality 
improved  whereas  if  the  number  of  occurrences  increased  then  the  quality 
decreased.  It  was  additionally  assumed  that  PQDRs,  RODs,  and  other 
complaints  had  equal  importance  and  weight. 

Second,  the  QEP  data  records  actions  that  have  been  taken  against  a 
particular  NSN  and  CAGE  pair.  These  actions  or  lack  of  actions  were  also 
analyzed.  The  QEP  indicated  what  actions  have  been  taken  in  the  past  for 
an  NSN  and  CAGE  pair  which  may  or  may  not  be  necessary  in  the  future.  As 
the  Quality  Evaluation  Program  Training  Guide  states,  "Further,  use  of  the 
information  cumulated  in  the  QEP  enables  the  contracting  element  to  make 
effective  use  of  quality,  packaging  and  shipment  histories  to  minimize 
awards  made  to  contractors  with  questionable  records.  Since  the  Defense 
Supply  Centers  have  the  responsibility  to  supply  high  quality  goods  and 
support  customer  orders,  contractors  with  unsatisfactory  quality  histories 
either  are  not  to  be  awarded  contracts  or  awarded  contracts  only  after 
careful  consideration  of  their  quality  histories  and  future  production 
capacity."  Many  of  the  QEP  data  elements  relate  to  extraordinary  measures 
taken  by  DSC/DCAS  personnel  to  insure  quality  requirements  were  met.  As 
such,  they  were  not  indicators  of  negative  quality  like  the  CDCS,  but 
rather  measures  of  resource  requirements  needed  to  achieve  acceptable 
levels  of  quality.  If  the  number  of  actions  increased  after  competition 
status  changed,  then  it  was  assumed  that  quality  decreased  whereas  if  the 
number  of  actions  decreased,  then  it  was  assumed  that  quality  improved. 
All  types  of  quality  actions  were  considered  as  being  equal  in  weight. 

2.  Development  of  Data.  The  two  sources  used  to  define  quality 
are  discussed  below. 

a.  CDCS  Data.  The  data  from  the  CDCS  file  consisted  of  the 
type  of  complaint,  the  date  the  complaint  was  initiated,  the  cause  of  the 
complaint,  the  Procurement  Instrument  Identification  Number  (PUN)  and  the 
CAGE  code.  The  PUN  and  CAGE  code  was  used  to  match  the  complaint  to  the 
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contract  from  the  ACF  file.  The  date  of  the  contract  was  compared  to  the 
date  of  the  AMC/AMSC  change  to  determine  if  the  complaint  was  associated 
with  a  contract  before  or  after  the  competition  status  changed.  The 
complaints  consisted  of  QDRs,  RODs ,  and  others.  Table  3  lists  the  various 
codes  and  the  document  type  used  from  the  CDCS  file.  Contractor -caused 
complaints  were  coded  as  "CN,"  "CS"  and  "CP." 

b.  PEP  Data.  The  data  from  the  QEP  file  consisted  of  the 

following: 

(1)  First  Article  (FA)  Data  -  included  data  on 
qualification  substitute,  status  (approved,  conditionally  approved, 
disapproved  or  waived)  and  results  (FA  data  may  occur  up  to  three  times); 

(2)  Preaward  Survey  Data  -  preaward  survey  information 
included  major  factors  (technical  capability,  production  capability, 
Quality  Assurance  (QA)  capability,  financial  capability  and  accounting 
system)  and  other  factors  (government  property,  transportation,  packaging, 
security,  safety,  environment/energy  and  other); 

(3)  Post  Award  Data  -  consisted  of  significant 
results/findings  for  the  latest  post  award  conference,  Quality  Systems 
Review  (QSR)  and  Quality  Systems  Management  Visit  (QSMV) ; 

(4)  Nonconformance  Data  -  none onfo mane e  data  consisted 
of  types  of  nonconformances  including  waivers  (major  and  minor)  and 
deviations  (major  and  minor),  QA  recommendation,  Procuring  Contracting 
Officer  action,  coordinating  activity,  date  of  nonconformance  and  number; 

Table  3 

CDCS  DOCUMENT  TYPE  CODES 


Category 

PQDR 


ROD 


OTHER 


CDCS  Document 

lype  Definition 

0  Category  I  PQDR,  SF  368,  Phone  Call,  or 

Message 

1  Category  II  PQDR,  SF  368,  Phone  Call,  or 

Message 

6  SF  364,  ROD,  Direct  Vendor  Delivery 

to  Customer 

7  SF  364,  ROD,  Depot  Delivery  to  Customer 

8  SF  364,  ROD,  Depot  Customer  Return 

9  SF  364,  ROD,  Depot  Contract  Receipt 

2  Phone  call.  Message,  or  Other 

3  SF  361,  Discrepancy  in  Shipment  Report 

4  DLA  Quality  Audit 

5  DD  Form  1225,  Storage  and  Quality  Control 

Report 
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(5)  Special  QA  Data  -  recorded  any  special  QA  actions 
taken  with  the  date  and  comments  (may  occur  up  to  four  times) ; 

(6)  Quality  Assurance  Letter  of  Instruction  (QALI)  - 
consisted  of  the  reason  for  the  QALI  (restrict  use  of  Certificate  of 
Conformance  by  Contract  Administration  Office,  Center  Imposed  Inspections, 
Technical  Activity  Imposed  Inspections,  Past  Contractor  Quality  Problems, 
Past  Item  Quality  Problems,  Nonconformance  Acceptance  Withheld,  Additional 
Quality  Data  and  Individual  Repair  Parts  Ordering  Date) ;  and 

(7)  Quality  Data  -  consisted  of  quality  requirement  (No 
specific  quality  requirement,  contractor  responsibility  provision,  standard 
inspection  requirement,  inspection  system  i.e.,  MIL-I-45208A  or  equivalent, 
quality  program  i.e.,  MIL-Q-9858A  or  equivalent,  contractor  paid  U.  S. 
Department  of  Agriculture  inspection,  contractor  paid  U.  S.  Department  of 
Commerce  inspection,  DPSC  alternative  requirement  clause  and  other  than 
above) ,  acquisition  quality  assurance  (destination  or  origin) ,  acceptance 
site  (destination  or  origin)  and  certificate  of  conformance. 

The  above  elements  were  matched  to  the  contracts  from  the  ACF  file  by 
matching  the  NSN  and  CAGE  pair  with  the  PUN.  The  award  date  of  the 
contract  from  the  ACF  was  compared  to  the  date  of  change  of  the  AMC/AMSC 
codes  to  determine  if  the  QEP  actions  were  associated  with  a  contract 
before  or  after  the  competition  status  change  date.  The  steps  taken  to 
develop  the  data  base  and  to  analyze  the  data  are  illustrated  by  Figure  1. 

VII.  ANALYSIS.  The  analysis  consisted  of  two  approaches.  First,  the  CDCS 
data  were  plotted.  The  number  of  competition  status  changes  per  quarter 
and  the  number  contractor -caused  complaints  per  quarter  were  plotted. 
These  graphs  compared  the  centers  and  illustrated  the  limitations  of  the 
data.  Second,  the  data  were  analyzed  using  Statistical  Package  for  the 
Social  Sciences  (SPSS)  Crosstabs  option  to  compare  the  before  competition 
status  change  CDCS  performance  and  QEP  pattern  with  the  respective  after 
competition  status  change  performance  or  pattern.  Statistical  hypothesis 
tests  were  run  to  determine  if  there  was  a  significant  difference  between 
the  before  and  after  data.  The  results  of  the  data  plots  and  hypothesis 
tests  are  discussed  below. 

A.  Data  Analysis.  The  number  of  competition  status  changes  per 
quarter  and  the  number  of  contractor-caused  complaints  for  competition 
status  changes  per  quarter  were  plotted.  Figures  2  and  3  show  these  plots. 
These  graphs  show  the  limitation  of  the  data.  One  limitation  that  was 
apparent  was  the  end  of  the  data  time  period  as  evident  by  the  downward 
slopes.  These  slopes  were  caused  by  the  length  of  time  to  close  out  CDCS 
complaints  (3  to  6  months  and  longer),  the  length  of  time  between  awarding 
a  contract  and  receiving  a  complaint  (6  months  and  longer)  and  the  length 
of  time  between  a  competition  status  change  date  and  a  contract  award  under 
the  new  competition  status  (months  to  years). 
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Figure  1 
DATA  FLOW 


COMPETITION  STATUS  CHANGES 

(CHANGES  IN  AMC/AMSC  CODES) 


11 


CONTRACTOR  CAUSED  COMPLAINTS 

(MATCHED  W/COMPETITION  STATUS  CHANGES) 


DATE  RECEIVED 


1.  Competition  Status  Changes.  Figure  2  compares  the  number  of 
identified  competition  status  changes  with  each  center.  This  graph  was 
based  on  the  study  methodology  previously  described  in  paragraph  VIB.  , 
Measurement  of  Competition.  Actual  breakouts  were  ongoing  at  all  centers 
throughout  the  1980s.  Note  that  DGSC  and  DISC  had  the  longest  recorded 
history  of  competition  status  changes  starting  in  the  first  quarter  of  1982 
(quarter  821) ,  DESC  competition  status  changes  started  in  the  second 
quarter  of  1985  (quarter  852)  and  DCSC  started  in  the  first  quarter  of  1987 
(quarter  871).  DCSC's  missing  data  prior  to  1987  was  caused  by  the  method 
used  to  identify  the  AMC/AMSC  code  changes  as  explained  in  paragraph  VIB2., 
Development  of  Data.  The  data  build  up  period  (FY  82-85)  was  caused  by  the 
fact  that  the  DLA  Operations  Research  and  Economic  Analysis  Management 
Support  Office  did  not  begin  to  collect  contracting  data  until  FY  85. 
These  competition  status  changes  represent  NSNs  whose  AMC  codes  changed 
from  either  sole  source  (codes  of  "3,”  "4,"  or  "5")  to  competition  (codes 
of  "1"  or  "2")  or  competition  to  sole  source  and  have  actual  manufacturer 
CAGEs  associated  with  them.  The  drop  off  in  the  number  of  competition 
status  changes  from  the  fourth  quarter  of  1988  on  were  due  to  the  end  of 
the  data  collection  period  (results  of  the  time  lag  to  verify  code  changes 
and  to  award  a  contract  under  the  new  code)  .  It  should  be  noted  that  the 
time  period  for  stable  data  was  from  1986  through  1988  except  for  DCSC 
which  turned  out  to  be  1987  through  1988. 

2 .  CDCS  -  Contractor-Caused 

The  contractor -caused  CDCS  complaints  matched  with  the  competition  status 
changes  associated  with  manufacturers  are  depicted  by  Figure  3.  There  were 
apparent  increasing  slopes  which  were  associated  with  the  data  build  up. 
Two  reasons  for  the  build  up  were: 

a.  The  build  up  matches  the  AMC/AMSC  changes;  and 

b.  The  CDCS  file  was  a  new  data  base.  New  data  bases  will 
require  time  to  capture  all  transactions. 

The  sharp  decreases  were  due  to  the  end  of  the  data  collection.  The  sudden 
drop  was  a  result  of  delays  in  establishing  cause  codes  which  were  required 
to  close  out  a  record  on  the  CDCS  file.  There  were  complaints  on  file 
during  the  drop  off,  but  these  complaints  were  not  counted  because  the 
cause  codes  were  not  yet  determined.  Notice  that  the  number  of  contractor- 
caused  complaints  for  DESC  and  DGSC  appeared  to  be  high,  peaking  a  range 
from  170  to  250  per  quarter,  whereas  the  number  of  contractor  cause 
complaints  for  DCSC  and  DISC  were  lower  peaking  with  a  range  from  40  to  60 
per  quarter. 

3.  Relationships .  The  number  of  competition  status  changes  and  the 
number  of  contractor -caused  complaints  were  plotted  for  each  center  to 
illustrate  the  relationships  between  the  two.  These  relationships  are 
discussed  by  center  below. 
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a.  DCSC .  The  impact  of  comparing  yearly  CTDF  header 
segments  for  competition  status  change  identifications  was  clearly  evident 
by  Figure  4.  The  data  for  competition  status  change  ranged  from  1987 
(quarter  871)  through  the  second  quarter  of  1989  (quarter  892).  This 
limited  range  restricted  our  ability  to  measure  the  effect  at  DCSC  to  the 
same  degree  as  the  other  DSCs.  The  number  of  contractor-caused  complaints 
remained  relatively  level  even  when  the  number  of  competition  status 
changes  varied. 

b.  DESC .  Figure  5  indicated  that  the  number  of  contractor - 
caused  complaints  and  the  number  of  competition  status  changes  tended  to 
move  (increase  and  decrease)  in  the  same  direction  together. 

c.  DGSC .  Figure  6  indicated  that  the  number  of  contractor- 
caused  complaints  increased  while  the  number  of  competition  status  changes 
tended  to  decrease  from  the  first  quarter  of  1987  (871)  onward. 

d.  DISC .  Figure  7  indicated  that  the  number  of  contractor- 
caused  complaints  tended  to  remain  level  while  the  number  of  competition 
status  changes  varied  in  a  range  from  700  to  1000. 

B.  CDCS  Data 

The  limitation  of  the  data,  previously  discussed,  and  the  low  number  of 
contractor-caused  complaints  may  influence  the  results.  Table  4  lists  the 
number  of  observations,  the  number  of  contractor -caused  complaints,  and  the 
percentage  of  contractor-caused  complaints  for  each  center.  The  percentage 
of  contractor-caused  complaints  ranged  from  a  low  of  1.88  percent  to  a  high 
of  7.60  percent  with  an  average  4.02  percent.  Thus,  complaints  were 
relatively  rare  occurrences  with  or  without  competition. 

The  following  hypotheses  were  tested: 

1.  The  null  hypothesis  was  that  the  CDCS  record  types  were 
equally  likely  to  occur  under  both  types  of  competition  (sole  source  versus 
competition) . 

2.  The  alternative  hypothesis  was  that  the  CDCS  record  types 
were  not  equally  likely  to  occur  under  both  types  of  competition. 


Figure  4 
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Competition  Statu*  Change*  k  Complaints 


QUARTER 
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Figure  6 
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Figure  7 
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Table  4 


PERCENTAGE  OF  CONTRACTOR- CAUSED  COMPLAINTS 


Center 

Number  of 
contract  lines 

Number  of  contractor- 
caused  comolaints 

Percentage  of  contractor 
caused  comolaints 

DCSC 

9,118 

292 

3.20% 

DESC 

11,483 

873 

7.60% 

DGSC 

22,987 

1,057 

4.60% 

DISC 

21.865 

ill 

1.88% 

TOTALS 

65,453 

2,633 

4.02% 

The  null  hypothesis  indicated  that  the  variable,  CDCS  record  type  and  type 
of  competition,  were  independent  (i.e.,  unrelated)  whereas  the  alternative 
hypothesis  indicated  that  the  variables  were  dependent  (i.e.,  related). 
When  the  null  hypothesis  was  accepted,  there  was  consequently  no  relation 
between  CDCS  record  type  and  the  type  of  competition.  This  meant  that  the 
various  CDCS  record  types  were  just  as  likely  to  occur  before  competition 
status  change  as  afterwards.  Whereas  when  the  alternative  hypothesis  was 
accepted,  then  there  was  a  statistical  relationship  indicated  between  the 
CDCS  record  types  and  type  of  competition.  This  could  be  interpreted  to 
indicate  that  the  various  CDCS  record  types  were  more  likely  to  occur  under 
one  type  of  competition  (competition  or  sole  source)  than  under  the  other. 

The  level  of  significance  of  the  test  was  selected  to  be  0.01.  This  meant 
that  1  percent  of  the  time  the  null  hypothesis  would  be  rejected  when  it 
should  have  been  accepted.  Table  5  provides  a  summary  of  the  results  and 
Appendix  B  provides  the  SPSS  output  of  the  crosstabulations  and  hypotheses 
tests  for  the  various  centers  and  cases. 

The  results  from  Table  5  were  mixed.  Table  5  indicates  that  the 
relationship  between  competition  and  quality  was  positive  for  DCSC  and  DISC 
in  that  more  frequent  complaints  were  received  under  sole  source 
conditions.  However,  the  relationship  was  negative  for  DESC  and  DGSC  when 
NSNs  were  broken  out  from  sole  source  to  competition.  Both,  DCSC  and  DISC 
data  analysis  (Figure  4  and  Figure  7)  illustrated  that  the  number  of 
contractor -caused  complaints  were  relatively  constant  while  the  number  of 
competition  status  changes  varied.  This  may  account  for  the  positive 
impact  of  competition  on  quality.  DESC  and  DGSC  data  analysis  (Figure  5 
and  Figure  6)  illustrated  that  the  number  of  cowcractor-caused  complaints 
tended  to  increase  while  me  number  of  competition  status  changes  increased 
for  DESC  and  decreased  for  DGSC.  This  would  serve  to  indicate  that  there 
had  been  a  potential  negative  impact  of  competition  on  quality  for  DESC  and 
DGSC. 
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Table  5 


CDCS  RESULTS 


Multiple  sources  Single  source 


Sole  source  to 
Competition 

Sole  source  to 
Reversion  Competition 

Reversion 

DCSC 

R+ 

R+ 

A+ 

R+ 

(2758) 

(1457) 

(3424) 

(1479) 

DESC 

R- 

X 

R- 

X 

(5099) 

(0) 

(6373) 

(11) 

DGSC 

R- 

A- 

R- 

X 

(21727) 

(693) 

(528) 

(39) 

DISC 

A+ 

A+ 

R+ 

A+ 

(7339) 

(408) 

(13376) 

(742) 

Legend: 

A  -  Accept 

the  Null 

hypothesis  -  the  type 

of  competition 

and  record  type 

R  -  Reject  the  Null 

are  unrelated 

hypothesis  and  accept 

the  alternativi 

the  type  of  competition  and  record  type  are  related 
-  -  Decrease  in  quality  (more  complaints  -  percentage  wise) 

+  -  Improvement  in  quality  (fewer  complaints  -  percentage  wise) 
X  -  Insufficient  data 

Numbers  in  (  )'s  are  the  number  of  contract  lines  (The  CDCS  numbers  and  the 
QEP  numbers  may  not  agree  because  a  contract  line  may  have  multiple 
complaints  and/or  multiple  QEP  requirements.) 

The  results  for  reversions  (when  competition  reverts  back  to  sole  source) 
were  counter-intuitive.  If  competition  had  an  effect  on  quality  then  the 
reversion  cases  should  have  opposite  signs  from  the  breakout  cases.  This 
was  not  observed.  Reversions,  tended  to  have  the  same  effect  as  breakouts 
(same  sign).  The  results  of  the  reversion  cases  were:  three  cases  did  not 
have  sufficient  data  (both  of  DESC's  and  DGSC  single  source  case);  two 
cases  had  a  significant  positive  impact  (both  of  DCSC's  cases);  two  cases 
had  an  insignificant  positive  impact  (both  of  DISC'S  cases);  and  only  one 
case  had  an  insignificant  negative  impact  (DGSC  multiple  source  case) . 
Reversion  accounted  for  only  4,829  observations  or  only  7.4  percent  of  all 
the  observations.  The  relatively  low  number  of  occurrences  and  the  fact 
that  the  results  were  significant  at  DCSC  (which  had  the  least  reliable 
data  for  determining  the  date  of  competition  status  change)  suggests  that 
more  data  is  needed  to  draw  conclusions  concerning  reversion. 
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c.  QEf 


The  low  number  of  QEP  actions  for  competition  status  changes  are 
illustrated  in  Table  6.  The  number  of  observations,  the  number  of  QEP 
actions,  and  the  percentage  of  QEP  actions  are  listed  for  each  center.  The 
percentage  of  QEP  actions  ranged  from  a  low  of  .77  percent  to  a  high  of 
6.06  percent,  giving  an  overall  QEP  action  average  of  3.77  percent. 

Table  6 

PERCENTAGE 

OF  OEP  ACTIONS 

Center 

Number  of 
contract  lines 

Number  of 
OEP  actions 

Percentage  of 
OEP  actions 

DCSC 

8,715 

67 

.77% 

DESC 

10,883 

660 

6.06% 

DGSC 

22,565 

837 

3.71% 

DISC 

21.493 

839 

3.90% 

TOTALS 

63,656 

2,403 

3.77% 

The  hypotheses  tested  were  the  following: 

1.  The  null  hypothesis  was  that  the  QEP  record  types  were 
equally  likely  to  occur  under  both  types  of  competition  (competition  or 
sole  source) . 

2.  The  alternative  hypothesis  was  that  the  QEP  record  types  were 
not  equally  likely  to  occur  under  both  types  of  competition. 

The  null  hypothesis  indicated  that  the  variables,  QEP  record  type  and  type 
of  competition,  were  independent  (i.e.,  unrelated)  whereas  the  alternative 
hypothesis  indicated  that  the  variables  were  dependent  (i.e.,  related). 
When  the  null  hypothesis  was  accepted,  then  there  was  no  apparent  relation 
between  QEP  record  type  and  the  type  of  competition.  This  meant  that  the 
various  QEP  record  types  were  just  as  likely  to  occur  after  break  out  to 
competition  as  compared  to  the  prior  sole  source  conditions.  When  the 
alternative  hypothesis  was  accepted,  it  was  inferred  that  there  was  a 
relationship  between  the  QEP  record  types  and  type  of  competition.  This 
could  be  interpreted  that  the  various  QEP  record  types  were  more  likely  to 
occur  under  one  type  of  competition  than  the  other. 

The  null  hypothesis  was  rejected  at  the  significant  level  of  0.01.  This 
meant  that  1  percent  of  the  time  the  null  hypothesis  would  be  rejected  when 
it  should  have  been  accepted.  Table  7  provides  the  summary  results  and 
Appendix  C  provides  the  SPSS  output  of  the  crosstabulations  and  hypotheses 
tests  for  the  various  centers  and  cases.  These  results  are  discussed 
below. 


19 


The  results  for  the  scenarios  of  breaking  out  an  NSN  were  consistent  from 
center  to  center.  After  an  NSN  was  broken  out,  more  quality  actions 
occurred.  In  six  out  of  eight  cases,  the  results  were  significant  at  a 
level  of  0.01.  For'  multiple  sources  cases,  DESC,  DGSC  and  DISC  results 
were  significant  indicating  an  increase  in  QEP  actions  after  break  out. 
The  results  for  single  source  cases  were  also  significant  for  DCSC,  DESC 
and  DISC  indicating  an  increase  in  QEP  actions.  Even  when  the  differences 
were  insignificant,  the  percentage  of  QEP  actions  increased  after  breakout. 

Table  7 
QEP  RESULTS 


Multiple  sources 


Sole  source  to 
competition 


Reversion 


Sole  source  to 
competition 


Single  source 

Reversion 


DCSC 

A- 

A+ 

R- 

A+ 

(2624) 

(1310) 

(3382) 

(1399) 

DESC 

R- 

X 

R- 

X 

(4745) 

(0) 

(6127) 

(ID 

DGSC 

R- 

A- 

A- 

X 

(21356) 

(676) 

(494) 

(39) 

DISC 

R- 

R- 

R- 

R- 

(7203) 

(374) 

(13185) 

(731) 

Legend: 

A  - 

Accept  the  Null 
and  record  type 

hypothesis  -  the  type 
are  unrelated 

of  competition 

R  - 

Reject  the  Null  hypothesis  and  accept  the  alternative  - 
the  type  of  competition  and  record  type  are  related 

-  - 

Decrease  in  quality  (more  QEP  actions 

-  percentage  wise) 

+  - 

Improvement  in  quality  (fewer  QEP  actions  -  percentage  wise) 

X  -  Insufficient  data 


Numbers  in  (  )'s  are  the  number  of  contract  lines  (The  CDCS  numbers  and  the 
QEP  numbers  may  not  agree  because  a  contract  line  may  have  multiple 
complaints  and/or  multiple  QEP  requirements . ) 
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The  reversion  scenarios  produced  mixed  results.  The  total  number  of 
observations  for  reversion  was  only  4,540  or  7.1  percent  of  the  total 
number  of  observations.  The  results  depicted  that  two  cases  had  a  positive 
impact,  but  the  differences  were  not  statistically  significant  (both  of 
DCSC's  cases),  three  cases  had  insufficient  data  (both  of  DESC's  and  DGSC 
single  source  case)  and  the  remaining  three  cases  had  a  negative  impact 
(DGSC  multiple  sources  case  and  both  of  DISC'S  cases).  DGSC  multiple 
sources  case  was  statistically  insignificant  whereas  DISC'S  cases  were 
statistically  significant. 

The  results  of  the  QEP  data  were  counter-intuitive  for  some  of  the 
reversion  cases.  Again,  it  was  expected  that  if  competition  had  an  impact 
on  quality  then  the  signs  would  be  opposite  of  the  sole  source  to 
competition  cases.  This  only  occurred  for  DCSC  with  insignificant  results. 
DESC  had  insufficient  data.  DGSC  results  were  insignificant.  Finally, 
DISC  results  for  multiple  sources  and  single  source  were  significant.  In 
general,  the  lack  of  observations  on  reversion  to  sole  source  limits  any 
conclusion  on  evaluation  of  quality  changes. 
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APPENDIX  A 


AMC  CODES 


Co^e  Definition 

1  Competitive 

2  Competitive  first  time 

3  Direct  Purchase  Manufacturer 

4  Direct  Purchase  from  Actual  Manufacturer 

5  Noncompetitive 

AMSC  CODES 

Code  Definition 

A  Government’s  rights  questionable. 

B  Restricted  to  specified  source(s). 

C  Engineering  source  approval  by  design  control  activity. 
Contracting  from  approved  source(s). 

D  Data  needed  to  purchase  from  additional  sources  is  not 
physically  available. 

E  Contracting  status  can  be  improved. 

F  Item  is  in  phased  provisioning. 

G  Technically  suitable  and  legally  clear  for  advertising  and 
data  package  is  complete. 

H  Government  does  not  have  in  its  possession  sufficient, 
accurate,  or  legible  data  to  purchase  item  from  other 
sources . 

J  Contracting  restricted  to  system  prime  contractor. 

K  Class  1A  castings  (MIL-C-6021)  or  similar  type  forgings. 

L  Uneconomical  to  undertake  improve  contract  status. 

M  Application  of  master  or  coordinated  tooling. 


A- 2 


AMSC  CODES 


Code  Definition 

N  Requires  special  test  and/or  inspection  facilities  to 
maintain  ultraprecision  quality. 

P  Rights  of  data  legally  unavailable  and  cannot  be  acquired  by 
purchase . 

Q  Exceptional  unique  manufacturing  processes  or  materiels. 

R  Data  or  rights  to  data  are  not  owned  by  the  Government  and 
are  uneconomical  to  acquire. 

S  Tontracting  restricted  to  limited  source(s)  because  of 

security  classification. 

T  Contracting  controlled  by  Qualified  Products  List  procedures. 

U  Uneconomical  to  compete. 

V  High  reliability  part  under  a  formal  reliability  program. 

W  Purchase  by  method  indicated  if  military  or  adopted  industry 
specifications  are  substituted  for  contractor's  data  which 
are  subject  to  Government's  limited  rights  of  use. 

Y  Design  of  item  is  unstable. 

Z  Contracting  from  the  current  source  is  necessary  to  ensure 
standardization  and  interchangeability  of  parts. 
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APPENDIX  B 


CDCS  Data  -  Crosstabulations 


B-l 


These  crosstabulation  tables  were  grouped  by  center  for  each  scenario.  The 
record  type  from  the  CDCS  file  was  listed  across  the  top  of  the  table, 
these  were  labeled  as  follows: 


1. 

NONE  - 

No  complaints 

2. 

OTHER 

-  Other  complaints 

3. 

QDRS  - 

PQDRs ,  both  types  I  and  II 

4. 

RODS  - 

RODS,  all  types. 

The  type  of  competition  was  labeled  along  the  left  hand  side.  The  labels 
used  were : 


1. 

COMP  - 

Competition 

2. 

SOLE  - 

Sole  source 

The  number  of  observations  with  the  percentage  for  the  row  were  provided  in 
the  boxes.  The  title  of  the  table  refers  to  the  direction  of  the 
competition  change  (i.e.,  breakout  or  reversion).  For  sole  source  o 
competition  one  should  compare  the  values  starting  with  "SOLE"  and  going  to 
"COMP."  Using  che  NONE  (No  complaints)  column,  if  the  percentage  value 
increased  then  the  number  of  complaints  have  decreased  whereas  if  the 
percentage  value  decreased  then  the  number  of  complaints  increased.  The 
table  title  provides  the  scenario  as  listed  below: 

1.  Multiple  Sources  -  multiple  sources  have  been  awarded  contracts 
for  the  NSN. 


2.  Single  Source  -  a  single  source  has  been  awarded  contracts  for 
the  NSN,  both  before  and  after  break  out. 

The  Chi-square  statistic  was  used  to  evaluate  the  discrepancy  between 
observed  frequencies  and  expected  frequencies.  The  significance  indicated 
whether  to  accept  or  reject  the  null  hypothesis  (see  text  paragraph  VIIB. , 
CDCS  Data) . 
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Table  B-l 


COCS  -  SOLE  SOURCE  TO  COMPETITION  -  MULTIPLE  SOURCTS 
OCSC 


COUNT 
ROW  PCT 

I 

I 

I 

I 

NONE 

I 

ofHER 

I 

QORS 

I  KOOS 

I 

ROW 

total 

COMP 

I 

957 

I 

2 

I 

I 

9 

I 

9G0 

l 

98.9 

I 

.2 

I 

I 

.9 

1 

35.  1 

SOLE 

I 

1708 

I 

28 

I 

tr> 

I 

38 

I 

1  790 

I 

95.4 

I 

t  .6 

I 

.9 

I 

2.  1 

1 

64.9 

COLUMN 

2665 

30 

16 

47 

2758 

TOTAL 

96.6 

1  .  1 

.6 

1  7 

100.0 

CHI -SQUARE 

O.F. 

SIGNIFICANCE 

MIN  E . F 

C  C  L  L  r. 

25.31799 

3 

0.0000 

S  .6  16 

NONf 

Table  B-2 

COCS  -  COMPETITION  TO  SOLE  SOURCE  -  MULTIPLE  SOURCE', 
OCSC 


COUNT  I 

ROW  PCT  I  ROW 


i 

i 

NONE 

I 

OTHER 

1- 

OORS 

I  ROOS 

1 

total 

COMP  I 

1022 

I 

29 

I 

30 

I  20 

I 

1  101 

I 

92.8 

I 

2 . 6 

I 

2.7 

l  18 

I 

75  6 

SOLE  I 

350 

I 

1 

I 

3 

I  2 

l 

356 

I 

98.3 

I 

.  3 

I 

.8 

I  .  6 

I 

24 . 4 

COLUMN 

1372 

30 

33 

22 

1457 

TOTAL 

94 . 2 

2. 1 

2.3 

1 .5 

100.0 

CHI 'SQUARE  O.F. 

SIGNIFICANCE 

MIN  E.F. 

CELLS 

19.10740  3 

0 

0017 

5  375 

•  1  • 
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Table  B-3 


COCS  -  SOLE  SOURCE  TO  COMPETITION  -  SINGLE  SOURCE 
OCSC 


COUNT  I 

ROW  PCT  I  ROW 


I 

TOTAL 

I 

NONE 

I 

OTHER 

I 

OORS 

1 

RODS 

1 

♦  - 

-4- 

-4  - 

-4- 

-  *> 

COMP 

I 

12  17 

I 

I 

1 

I 

10 

I 

1223 

I 

99. 1 

I 

I 

.  1 

I 

.8 

I 

35.9 

— 

-4« 

-4- 

-  ♦ 

SOLE 

I 

2  150 

t 

12 

i 

6 

( 

2B 

r 

2  100 

I 

97.9 

I 

.5 

i 

.3 

I 

1  .  3 

i 

64  1 

-■f  ' 

-4« 

-4*. 

-  t 

COLUMN 

3367 

12 

7 

39 

3424 

TOTAL 

99.3 

.4 

.2 

1  .  1 

100  0 

CHI -SQUARE 

D.F. 

SIGNIFICANCE 

MIN  E.F. 

CELLS 

W  (  r  H  E  .  F  .  <  5 

9.74986 

3 

0.0208 

2.511 

3  OF 

a  (  37.5'/. 

Table  B-4 

COCS  '  COMPETITION  TO  SOLE  SOURCE  -  SINGLE  SOURCE 
OCSC 


COUNT  I 
ROW  PCT  l 


I 

t 

NONE 

I 

OTHER 

I 

QDRS 

I 

R005 

I 

TCT.1L 

COMP 

I 

809 

I 

28 

I 

7 

I 

16 

I 

860 

I 

94. 1 

I 

3.3 

I 

.8 

I 

1 .9 

I 

58  .  1 

SOLE 

I 

613 

I 

I 

I 

G 

l 

6  19 

I 

99.0 

I 

I 

l 

1  0 

I 

4  1.9 

COLUMN 

1422 

28 

7 

22 

1479 

TOTAL 

96.1 

1.9 

.5 

1.5 

100.0 

CHI 'SQUARE  O.F. 


SIGNIFICANCE 


MIN  E.F. 


CELLS  WITH  E .F . <  5 


28. 03487  3 


0.0000 


2  330 


2  OF  3  (  35  O  '  ) 
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Table  B-5 


COCS  -  SOLE  SOURCE  TO  COMPETITION  -  MULTIPLE  SOURCES 
OESC 


COUNT  I 

row  per  t 
I 


ROW 

TOTAL 


I 

NONE 

I 

OTHER 

I 

OORS 

I 

RODS 

1 

COMP  I 

1496 

I 

24 

I 

1  1 

l 

137 

I 

1668 

I 

89 . 7 

I 

1 . 4 

I 

.7 

I 

a  2 

I 

32  7 

SOLE  I 

317  1 

I 

25 

I 

42 

I 

193 

4 

343  1 

I 

92.4 

I 

.7 

1 

1.2 

t 

5  6 

i 

67 . 3 

COLUMN 

4667 

49 

S3 

330 

5099 

TOTAL 

91 .5 

1  .0 

1  .0 

6.5 

100  0 

CHI -SQUARE 

O.F. 

SIGNIFICANCE 

MIN 

E.F  . 

CELLS 

21.86769 

3 

0 

.0001 

16.029 

NONi 

E.F.< 
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Table  B-6 

COCS  -  COMPETITION  TO  SOLE  SOURCE  -  MULTIPLE  SOURCES 
OESC 


THE  2-WAY  TABLE  FOR  THE  FOLLOWING  VARIABLES  WAS  EMPTY 
COM  RECT 
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Table  B-7 


COCS  -  SOLE  SOURCE  TO  COMPETITION  -  SINGLE  SOURCE 

OESC 


COUNT  I 

ROW  PCT  I  ROW 


l 

I 

NONE 

I 

OTHER 

I 

QORS 

l 

RODS 

i 

TOTAL 

COMP 

I 

2199 

I 

5 

I 

1 

I 

164 

I 

2369 

I 

92  a 

.  I 

.2 

I 

.0 

I 

6.9 

I 

37.2 

SOLE 

I 

373-1 

I 

4-1 

I 

23 

I 

203 

t 

4004 

I 

93.3 

I 

t .  1 

I 

.  6 

I 

5.  1 

i 

62.8 

COLUMN 

5933 

49 

24 

367 

6373 

TOTAL 

93.  1 

.a 

.  4 

s  a 

too  o 

CHI-SQUARE 

O.F. 

SIGNIFICANCE 

MIN  E  .  F  . 

CELLS  W 1 1 M 

3S.3S692 

3 

0.0000 

8.921 

NONE 

Table  B-8 

COCS  -  COMPETITION  TO  SOLE  SOURCE  -  SINGLE  SO 
OESC. 


COUNT  l 


ROW  PCT 

NONE 

1 

RODS 

l 

ROW 

TOTAL 

COMP 

6 

I 

1 

I 

7 

85.7 

I 

14.3 

I 

63.6 

SOLE 

4 

l 

l 

4 

100.0 

I 

I 

36.4 

COLUMN 

10 

1 

1 1 

TOTAL 

90.9 

9. 1 

100.0 

STATISTIC  ONE  TAIL  TWO  TAIL 


FISHER'S  EXACT  TEST  0.63636  I  '  ‘JQO 
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Table  B-9 


COCS  -  SOLE  SOURCE  TO  COMPETITION  -  MULTIPLE  SOURCES 
OGSC 


COUNT  I 
ROM  PC  T  I 


l 

TOTAL 

I 

NONE 

I 

OTHER 

I 

OORS 

I 

ROOS 

t 

■  ♦  ■ 

-  f  - 

-♦* 

-  * 

COMP 

I 

16466 

I 

306 

I 

101 

I 

476 

I 

17349 

I 

94 . 9 

I 

t .  a 

( 

.  6 

t 

2  .  7 

I 

79 . 8 

SOLE 

I 

4  290 

l 

17 

I 

2  1 

I 

SO 

I 

•1373 

I 

98  .  O 

I 

.  4 

I 

.  5 

I 

\  1 

I 

20. 2 

COLUMN 

20756 

323 

122 

526 

2  1727 

TOTAL 

95.5 

1 . 5 

.6 

2  4 

100.0 

CHI -SQUARE 

D.F  . 

SIGNIFICANCE 

85.65453 

3 

0.0000 

MIN  E . F . 


24  583 


CELLS  - ! I H  E  F . <  5 


NONE 


Table  B-10 

COCS  -  COMPETITION  TO  SOLE  SOURCE  -  MULTIPLE  SOUUCl.. 
OGSC 


COUNT  I 

ROW  PCT  I  ROW 

l  TOT  A ( 


I 

NONE 

I 

OTHER 

I 

OORS 

I 

ROOS 

1 

-  V 

COMP 

l 

82 

I 

1 

I 

I 

1 

I 

8  4 

I 

97.6 

I 

1.2 

I 

I 

1  2 

I 

12.1 

SOLE 

I 

562 

I 

19 

I 

6 

r 

22 

I 

GOO 

I 

92.3 

I 

3. 1 

I 

1 .0 

I 

3  6 

I 

87.9 

COLUMN 

644 

20 

6 

23 

693 

TOTAL 

92.9 

2.9 

.9 

3  3 

100.0 

CHI-SQUARE  0 . F . 


SIGNIFICANCE 


MIN  E.F. 


CELLS  WITH  E  .  F  .  <  5 


3.31069  3 


0.3462 


i'  73;  3  ni 


3?  r  -  I 
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Table  B— 1 1 

COCS  -  SOLE  SOURCE  TO  COMPETITION-  SINGLE  SOURCE 
OGSC 


COUNT  I 

ROW  PCT  I  Row 


I  TOT  ■*.!. 


I 

NONE 

I  OTHER 

I 

OORS 

I 

ROOS 

1 

COMP  I 

322 

I  4 

I 

18 

I 

13 

I 

357 

I 

90.2 

I  1  .1 

I 

5.0 

I 

3  6 

I 

67  G 

SOLE  I 

170 

I 

I 

1 

I 

I 

17  1 

t 

99 . 4 

I 

I 

.6 

I 

I 

32  .  A 

COLUMN 

492 

4 

19 

13 

528 

TOTAL 

93  2 

.  a 

3 . 6 

2  5 

too  O 

CHI-SOUARE 

OF. 

SIGNIFICANCE 

MIN 

E  F  . 

CELLS 

15.58063 

3 

0.0014 

1 .295 

3  OF 

I  H  E 


8  ( 


Table  B-12 

COCS  -  COMPETITION  TO  SOLE  SOURCE-  SINGLE  SOURCE 
OGSC 


COUNT  I 

ROW  PCT  I  ROW 


I 

I 

NONE 

1 

RODS 

I 

TOTAL 

COMP 

I 

17 

I 

I 

17 

I 

100.0 

I 

I 

43 . 6 

♦  * 

-♦ 

SOLE 

I 

2  1 

I 

1 

I 

22 

I 

95.5 

I 

4 . 5 

I 

56 . 4 

COLUMN 

38 

1 

39 

TOTAL 

97.4 

2.6 

100.0 

CHI-SOUARE 

O.F. 

SIGNIFICANCE 

MIN  E.F. 

CELLS  WITH 

0.00000 

0.79306 

1 

1 

1 .0000 

0.3732 

O  43G 

1  BEFORE 

?  or  : 

nres  con  1  i  i'i 

F  •  i 

37.57.) 


E.F.<  5 

(  r,r  -  '  i 

i  i 


B-8 


Table  B-13 

COCS  -  SOLE  SOURCE  TO  COMPETITION  -  MULTIPLE  SOURCE'S 
0 1  SC 


COUNT  I 
ROW  PCT  I 


I 

r 

NONE 

I 

OfHER 

i 

OCRS 

1 

RODS 

1 

TOTAL 

COMP 

i 

3375 

I 

14 

i 

14 

I 

40 

-  ¥ 

I 

3443 

1 

■ 

93.0 

I 

.4 

i 

.  4 

I 

1  .  2 

I 

46  9 

SOLE 

i 

33  18 

I 

16 

i 

10 

I 

52 

I 

3B96 

( 

98.0 

I 

.  4 

i 

.  3 

I 

1 . 3 

I 

S3  .  1 

COLUMN 

7  193 

30 

24 

92 

- 

7339 

TOTAL 

93.0 

.  4 

.  3 

1  .  3 

100.0 

CHI-SQUARE 

1.69356 


O.F. 


SIGNIFICANCE 

0.6384 


MIN  E.F. 

11.259 


CELLS  WUX  E.F.<  5 

NONE 


Table  B-14 

COCS  -  COMPETITION  TO  SOLE  SOURCE  -  MULTIPLE  SOURCE". 
DISC 


COUNT  I 

ROW  PCT  t  ROW 


I 

I 

NONE 

I 

OTHER 

I 

QORS 

I 

ROOS 

1 

rofAL 

COMP  I 

271 

I 

7 

l 

13 

I 

6 

I 

297 

I 

91.2 

I 

2.4 

I 

4.4 

I 

2.0 

I 

72.8 

SOLE  I 

107 

I 

I 

I 

4 

I 

1  I 

I 

96 . 4 

I 

I 

I 

3  G 

1 

27 . 2 

COLUMN 

378 

7 

13 

10 

408 

TOTAL 

92 . 6 

1  .  7 

3 . 2 

2  5 

100.0 

CH! -SQUARE,  O.F. 

SIGNIFICANCE 

MIN 

E.F. 

CELLS 

8.93268  3 

0 

.0362 

t  00  - 

3  OF 

B-9 


Table  B-15 


COCS  -  SOLE  SOURCE  TO  COMPETITION  -  SINGLE  SOURCE 

DISC 


COUNT  I 
ROW  PCT  I 
I 


ROW 

TOTAL 


I 

NONE 

I 

OTHER 

I 

OOPS 

I 

POOS 

l 

COMP 

I 

7084 

I 

1  1 

I 

9 

I 

76 

I 

7  180 

I 

98.7 

I 

.2 

I 

.  1 

I 

t  1 

I 

53 . 7 

SOLE 

I 

6077 

I 

22 

I 

22 

I 

75 

1 

G  196 

I 

98 . 1 

I 

.  4 

I 

.  4 

I 

1  .  2 

I 

46.3 

COLUMN 

13  161 

33 

31 

15  1 

13376 

TOTAL 

98.4 

.2 

.2 

1  .  1 

100.0 

CHI-SQUARE 

O.F. 

significance 

MIN  E.F. 

CELLS 

13.86189 

3 

0.0031 

14.360 

NONE 

Table  B-16 

COCS  -  COMPETITION  TO  SOLE  SOURCE  -  SINGLE  SOURCE 
DISC 


COUNT  I 

ROW  PCT  I  B0W 

t  TOTAL 


I 

NONE 

I 

OTHER 

I 

ODRS 

i 

RODS 

I 

COMP 

I 

361 

I 

4 

I 

3 

I 

6 

I 

374 

I 

96.5 

I 

1  .  1 

I 

.8 

i 

1  6 

l 

50.4 

SOLE 

I 

361 

I 

I 

i 

7 

I 

360 

I 

98 . 1 

l 

I 

i 

1  9 

I 

49  6 

COLUMN 

722 

4 

3 

13 

742 

TOTAL 

97 . 3 

.5 

.  4 

1 . 8 

100.0 

CHI-SQUARE  O.F. 


SIGNIFICANCE 


MIN  E.F.  CELLS 


1  .  488 


fH  E.F.<  S 


WITH  E . F . <  5 


7.02886 


3 


0.0710 


4  OF 


3  (  50  L 


APPENDIX  C 


These  crosstabulation  tables  were  grouped  by  center  for  each  scenario.  The 
record  type  from  the  QEP  file  was  listed  across  the  top  of  the  table,  these 
were  labeled  as  follows: 

1.  ALI  -  Quality  Assurance  Letter  of  Instruction 

2.  FA  -  First  Article  Data 

3.  LTY  -  Quality  Data 

4.  N/A  -  No  Actions  -  No  QEP  actions  taken 

5.  NON  -  Non-conformance  Data 

6.  PA  -  Post  Award  Data 

7.  PAS  -  Preaward  Survey  Data 

8.  SQA  -  Special  QA  Data 


The  type  of  competition  was  labeled  along  the  left  hand  side.  The  labels 
used  were: 


1. 

COMP  - 

Competition 

2. 

SOLE  - 

Sole  source 

The  number  of  observations  with  the  percentage  for  the  row  were  provided  in 
the  boxes.  The  title  of  the  table  refers  to  the  direction  of  the 
competition  change  (i.e.,  breakout  or  reversion).  For  sole  source  to 
competition  one  should  compare  the  values  starting  with  "SOLE"  and  going  to 
"COMP."  Using  the  N/A  (No  Actions)  column,  if  the  percentage  value 
increased  then  the  number  of  actions  have  decreased  whereas  if  the 
percentage  value  decreased  then  the  number  of  actions  increased.  The  table 
title  provides  the  scenario  as  listed  below: 

1.  Multiple  Sources  -  multiple  sources  have  been  awarded  contracts 
for  the  NSN. 

2.  Single  Source  -  a  single  source  has  been  awarded  contracts  for 
the  NSN,  both  before  and  after  break  out. 

The  Chi-square  statistic  was  used  to  evaluate  the  discrepancy  between 
observed  frequencies  and  expected  frequencies.  The  significance  indicated 
whether  to  accept  or  reject  the  null  hypothesis  (see  text  paragraph  VIIC., 
QEP  Data) . 


C-2 


Table  C-l 

'  QEP  -  SOLE  SOURCE  TO  COMPETITION  -  MULTIPLE  SOURCTS 

ocsc 


COUNT  I 


ROW  PCT  I 

I 

I 

FA 

i 

•LTY 

I 

N/A 

I 

NON 

I 

SQA 

ROW 

TO  r  AL 

r 

COMP  I 

1 

i 

2 

I 

946 

I 

5 

I 

1  957 

I 

.  1 

I 

.2 

I 

98 . 9 

I 

.5 

I 

.3 

I  36.5 

SOLE  I 

t 

t 

3 

I 

1657 

I 

1 

I 

l  I  « A  G  1 

I 

.  1 

l 

.2 

I 

99.4 

I 

.  1 

I 

.3 

I  63.5 

COLUMN 

2 

5 

2603 

6 

0 

2624 

TOTAL 

.  1 

.2 

99 . 2 

.  2 

:j 

ICO  0 

CHI -SQUARE  O.F. 

significance 

MIN  E 

.F. 

CELLS 

WITH  E  .  F  5 

S. 89397  4 

0. 

2072 

O. 

729 

7  or 

IO  (  70  O/.l 

Table  C-2 

QEP  -  COMPETITION  TO  SOLE  SOURCE  -  MULTIPLE  SOURCE'S 
OCSC 


COUNT  I 
ROW  PCT  I 
t 


UCJ  w 

TOTAL 


I 

FA 

I 

N/A 

I 

NON 

l 

PA 

t 

r.  0  A 

1 

COMP 

I 

4 

I 

945 

I 

6 

I 

5 

I 

7 

1  967 

I 

.  4 

I 

97.7 

I 

.6 

I 

5 

1 

.  7 

1  73.8 

SOLE 

I 

1 

I 

34  1 

I 

I 

t 

I 

1  343 

I 

.3 

I 

99.4 

I 

I 

3 

I 

I  26.2 

COLUMN 

9 

1286 

6 

6 

7 

13  10 

TOTAL 

.4 

98.2 

.5 

.  5 

.  5 

100.0 

CHI-SQUARE 

O.F. 

SIGNIFICANCE 

5 . 06506 

4 

0.2807 

MIN  E.F. 


1  309 


CELLS  WITH  E . F  .  <  5 


7  or  i ' '  (  70  0  I 


C-3 


Table  C-3 

QEP  -  SOLE  SOURCE  TO  COMPETITION  -  SINGLE  SOURCE 
DC  SC 


Table  C-4 

OEP  -  COMPETITION  TO  SOLE  SOURCE  -  SINGLE  SOURCE 
OCSC 


COUNT  I 
ROW  PCT  I 

ROW 

I 

TOTAL 

I 

N/A 

I 

NON 

I 

SQA 

I 

COMP  I 

780 

I 

2 

I 

1 

I 

783 

I 

99.6 

I 

.  3 

I 

.  1 

I 

56  0 

SOLE  I 

6  16 

I 

I 

I 

6  16 

I 

100.0 

I 

I 

I 

44  .O 

COLUMN 

1396 

2 

1 

1399 

TOTAL 

99.8 

.  1 

.  1 

IOC  .0 

CHI-SQUARE  0 .  F . 

SIGNIFICANCE 

MIN 

E.F. 

CELLS  WITH 

E  .  F  .  <  5 

2. 36523  2 

0. 

3065 

O.It  J 

4  Oi 

(  66  ' 

C-4 


Table  C-5 

QEP  -  SOLE  SOURCE  TO  COMPETITION  -  MULTIPLE  SOURCES 
OESC 


COUNT  I 
ROW  PCT  I 
I 


'••ow 

ru  l  m 


I 

FA 

I 

LTV 

I 

N/  A 

I 

MON 

1 

P  AS 

I  SOA  I 

COMP  I 

2 

I 

125 

I 

1370 

I 

15 

I 

10 

I  4  I 

1326 

I 

.  I 

I 

8.2 

1 

89.8 

I 

1 .0 

I 

.  7 

I  .31 

32 . 2 

SOLE  I 

( 

I 

as 

3  tOS 

I 

19 

I 

1 

t  r,  t 

37  19 

I 

.0 

I 

2.6 

I 

96. 5 

l 

.  6 

I 

.  1 

1  .21 

67 .  a 

COLUMN 

3 

2  IO 

4475 

34 

13 

IO 

1745 

TOTAL 

.  1 

4.4 

94.3 

.7 

.  3 

2 

100.0 

CHI-SQUARE 

0 .  F  . 

SIGNIFICANCE 

MIN  E 

■  F  . 

CELLS 

WITH  E . F . < 

5 

93.058(3 

5 

0. 

.0000 

0. 

965 

4  OF 

12  (  33. 

3%) 

Table  C-6 

OEP  -  COMPETITION  TO  SOLE  SOURCE  -  MULTIPLE  SOURCCS 
OESC 


THE  2-WAV  TABLE  FOR  THE  FOLLOWING  VARIABLES  WAS  EMPTY. 
COM  RECT 


C-5 


Table  C-7 

QEP  -  SOLE  SOURCE  TO  COMPETITION  -  SINGLE  SOURCE 
OESC 


COUNT 
ROW  PCT 


t 

I 

ALI 

I 

*  .FA 

I 

LTV 

r 

N/A 

I 

NON 

I  PAS 

I 

SO  A 

I 

COMP  I 

I 

2 

I 

2  tS 

I 

2032 

l 

29 

I 

\ 

I 

3 

I 

I 

I 

.  1 

I 

9.4 

I 

89.0 

I 

1 . 3 

I 

0 

I 

.  1 

I 

SOLE  1 

1 

I 

t 

105 

I 

37CG 

t 

2G 

l 

3 

I 

1 

I 

I 

.0 

I 

I 

2.7 

I 

96.4 

I 

.  7 

t 

.  1 

I 

.  1 

l 

COLUMN 

1 

2 

320 

5738 

55 

4 

7 

TOTAL 

.0 

.0 

5.2 

93.7 

.9 

.  1 

.  i 

CHI-SQUARE 

O.F. 

SIGNIFICANCE 

MIN 

E.F. 

CELLS 

WITH 

E. 

F  .  < 

5 

140.94054 

6 

0 

oooo 

0.372 

8  OF 

14 

( 

57  . 

i'/.) 

ROW 

ror.\i. 


2282 

37 . 2 

on  is 

62.3 


6127 
ICO  0 


Table  C-8 

OEP  -  COMPETITION  TO  SOLE  SOURCE  -  SINGLE  SOURCE 
OESC 


COUNT  I 
ROW  PCT  I 

ROW 

I 

TOTAL 

I 

LTY 

I 

N/A 

I 

COMP  I 

I 

7 

I 

7 

l 

1 

100.0 

1 

63.6 

SOLE  I 

1 

I 

3 

I 

l 

25  .0 

I 

75.0 

I 

36.4 

COLUMN 

1 

<0 

1 1 

TOTAL 

9.1 

90.9 

100.0 

STATISTIC 

ONE 

TAIL 

TWO  TAIL 

FISHER'S  EXACT  TEST 

0. 

36364 

O  36364 

06 


Table  C-9 

QtP  -  SOLE  SOURCE  TO  COMPETITION  -  MULTIPLE  SOURCES 
OGSC 


COUNT 
JOW  PCT 

I 

I 

I 

I 

ALI 

I 

FA  I 

LTV 

t 

M/A 

I 

BOW 
r  0  !  M 

1 

■  f  -  > 

-  ♦  -  - 

-  v  - 

. 

-  ►  * 

— 

► 

COMP 

I 

5 

I 

f  1  I 

700 

I 

IG37  1 

I 

t  -< 

I  17 OCT 

I 

.0 

I 

.  1  I 

4  .  1 

I 

95 . 7 

1 

1 

[  79  6 

>  - 

-  +  -• 

-  * 

-  ¥  - 

-  “  -  - 

* 

SOLE 

I 

I 

♦  - 

I 

I 

-  *  - 

I 

I 

43 

1 .0 

I 

I 

-  ► 

•1  TO''1 
94.0 

I 

I 

-  *■  - 

:  n  n 

l  20.1 

♦  -  -  ■ 

COLUMN 

TOTAL 

5  1 1 

.0  .1 

743 

3 . 5 

20579 

90 . 4 

1M 
.  \ 

2  1  356 

100.0 

CHI -SQUARE 

O.F. 

SIGNIFICANCE 

MIN 

E  .  r . 

CELL'. 

with  E  r  -  'i 

109.97484 

4 

0.0000 

1.018 

4  OF 

10  (  40  O' 

Table  C-10 

OEP  -  COMPETITION  TO  SOLE  SOURCE  -  MULTIPLE  SOURCES 
OGSC 


COUNT  I 

row  per  t 


I 


l 

ALI 

l 

LT7 

1 

•  *  -  * 

-  ¥  - 

COMP 

I 

I 

1 

I 

I 

I 

1.2 

I 

SOLE 

I 

1 

l 

37 

I 

I 

.  2 

I 

6.3 

I 

COLUMN 

1 

38 

TOTAL 

.  1 

5.6 

COW 

r  o  r  .u. 


N/A 

1 

MnN  I 

r,0A  : 

83 

I 

I 

i 

R4 

98.8 

I 

I 

i 

12  4 

-  V  -  ■ 

55? 

I 

l  1 

i  t 

r92 

93.2 

I 

.  2  I 

.  2  ' 

87  0 

-  4*  - 

635 

1 

\ 

676 

93.9 

.  1 

.  * 

100. 0 

CHI-SQUARE  O.F. 


SIGNIFICANCE 


min  e.f.  cells  with  e.f.<  s 


4 .01839  4 


0 . 4033 


oil  7  or  i '  (  to  or  i 


C-7 


Table  C-ll 

QEP  -  SOLE  SOURCE  TO  COMPETITION 
OGSC 


SINGLE  source 


COUNT 
ROW  PCT 

I 

I 

I 

I 

ALI 

I 

LTY 

I 

N/A 

COMP 

I 

4 

I 

10 

I 

309 

I 

1.2 

I 

3.1 

I 

95.7 

SOLE 

I 

l 

3 

I 

168 

I 

I 

1  8 

I 

98.2 

COLUMN 

4 

13 

477 

TOTAL 

a 

3  6 

96  6 

CHI-SQUARE 

2.95943 


SIGNIFICANCE 

0.2277 


494 

100.0 


MIN  E  F  . 


CELLS  WITH  E . F  <  S 
3  OF  G  (  50.0'/,) 


Table  C-12 

QEP  -  COMPETITION  TO  SOLE  SOURCE  -  SINGLE  SOURCE 
OGSC 


COUNT  I 
ROW  PCT  I 


I 

I 

LTY 

I 

N/A 

I 

TOTAL 

COMP 

I 

l 

17 

I 

17 

I 

I 

100.0 

I 

43.6 

SOLE 

I 

2 

I 

20 

l 

22 

1 

9.  1 

I 

90.9 

I 

56.4 

COLUMN 

2 

37 

39 

TOTAL 

5.  1 

94.9 

100.0 

CHI-SQUARE 


SIGNIFICANCE 


MIN  E.F. 


CELLS  WITH  E . F . <  5 


0  872  ;>  i;- 

(  nriowi  iMf,  );ni. 


•I  (  50  i  " ) 

I  I  'IN  ) 


0.29638 
< .  i»n 


i 

i 


0.5862 

0.2018 


Table  C-13 

QEP  -  SOLE  SOURCE  TO  COMPETITION  -  MULTIPLE  SOURCES 

orsc 


COUNT  I 


OW  PCT 

I 

u'UW 

I 

ro  PAL 

I 

ALI 

I 

FA 

I 

LTV 

t 

N/A 

I 

nc-i  r 

SO  A 

r  * 

-f-- 

-  ♦  - 

- -  -  -  - 

-  * 

COMP 

I 

t  1 

I 

50 

I 

206 

I 

3092 

I 

17  I 

7 

t  3378 

I 

.  3 

I 

1.5 

I 

6  .  1 

I 

9  15 

I 

1  [ 

.  2 

I  10  9 

♦  -  ■ 

“  ♦  - 

-  ♦  -  - 

- 

SOLE 

I 

2 

I 

15 

I 

10 

I 

3794 

I 

l  I 

I  3325 

I 

.  1 

I 

.  4 

I 

.  3 

I 

99  2 

I 

.  i  1 

I  5  7.1 

♦  -* 

- 

- 

COLUMN 

13 

65 

2  16 

6886 

i  r, 

7 

7?03 

TOTAL 

.  2 

.9 

3.0 

95.6 

.  j. 

.  1 

HjO.0 

CHI-SQUARE  D.F. 


258 .75157 


SIGNIFICANCE  MIN  E.F.  CELLS  - l Th  E.F.<  5 

0.0000  3.283  2  OF  12  (  16.7%) 


Table  C-14 

QEP  -  COMPETITION  TO  SOLE  SOURCE  -  MULTIPLE  SOURCt S 
OISC 


COUNT 
ROW  PCT 


SOW 
:  :  tal 


l 

ALI 

I 

FA 

I 

LTV 

I 

N/A 

I 

on:<  [ 

SO  A 

1 

COMP 

I 

1 

I 

5 

I 

1 

I 

257 

I 

f  l 

\ 

I 

266 

I 

.4 

I 

1.9 

I 

.4 

I 

96.6 

I 

.4  I 

.4 

I 

7  1.1 

SOLE 

t 

I 

2 

I 

9 

I 

96 

I 

1  1 

I 

108 

I 

I 

1.9 

I 

8.3 

I 

88.9 

I 

.9  I 

I 

28.9 

COLUMN 

1 

7 

10 

353 

2 

1 

374 

TOTAL 

.3 

1.9 

2.7 

94  4 

5 

.3 

100  0 

CHt-SOUARE 

O.F  . 

SIGNIFICANCE 

MIN  E.F. 

CELLS  WITH  E . F . <  5 

19.92342 

5 

0.0013 

O  . 

■i  ■  ,  >  (  7M 

09 


Table  C-15 


OEP  -  SOLE  SOURCE  TO  COMPETITION  -  SINGLE  SOURCE 
OISC 


COUNT  I 
ROW  PCT  I 

I 

I 

ALI 

I  FA 

I 

LTV 

I 

N/A 

i 

MOM 

SOW 
.rn  r.u. 

1  S')  A  1 

COMP  I 

13 

I  44 

I 

339 

I 

6687 

i 

1C 

I  717106 

I 

.2 

I  .6 

I 

4.8 

I 

94  .  1 

i 

.  2 

I  1  (  53.9 

SOLE  I 

5 

I  14 

I 

19 

I 

6030 

i 

9 

*  2  I  G079 

I 

.  1 

I  .  2 

I 

.  3 

I 

99.2 

i 

.  1 

I  0  I  45 . 1 

COLUMN 

18 

58 

358 

12717 

25 

9  13185 

TOTAL 

.  1 

.  4 

2.7 

96.5 

.2 

1  ICO  0 

CHI -SQUARE  O.F. 

SIGNIFICANCE 
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Abbreviation 

ACF 

AMC 

AMSC 

CAGE 

CDCS 

CTDF 

DCAS 

DCSC 

DESC 

DGSC 

DISC 

DLA 

DLA-LO 

DPSC 

DSC 

FA 

FY 

NSN 

PUN 

PQDR 

QA 

QALI 

QEP 

QSMV 

QSR 

ROD 

S/D/P 

SPSS 


List  of  Abbreviations 


Meaning 

Active  Contract  File 
Acquisition  Method  Code 
Acquisition  Method  Suffix  Code 
Commercial  and  Government  Entity 
Customer  Depot  Complaint  System 
Contracting  Technical  Date  File 
Defense  Contract  Administration  Services 
Defense  Construction  Supply  Center 
Defense  Electronics  Supply  Center 
Defense  General  Supply  Center 
Defense  Industrial  Supply  Center 
Defense  Logistics  Agency 

DLA  Operations  Research  and  Economic  Analysis  Office 

Defense  Personnel  Support  Center 

Defense  Supply  Center 

First  Article 

Fiscal  Year 

National  Stock  Number 

Procurement  Instrument  Identification  Number 
Product  Quality  Deficiency  Report 
Quality  Assurance 

Quality  Assurance  Letter  of  Instruction 

Quality  Evaluation  Program 

Quality  Systems  Management  Visit 

Quality  Systems  Review 

Report  of  Discrepancy 

Specification/Drawing/Publication 

Statistical  Package  for  the  Social  Sciences 
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